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Abstract 


In  the  simple  one-dimensional  random  walk  a  particle  moves  along 
a  line  in  unit  steps,  either  forward  or  backward.  Consider  the  motion 
of  the  particle  if  the  step  lengths  are  not  constant,  but  rather  vari¬ 
ables  tiiat  depend  on  the  position  of  the  particle  at  each  step.  Such 
a  generalization  of  the  random  walk  is  the  subject  of  these  studies. 

The  motion  of  the  particle  is  studied  in  some  detail.  If  x  is 
the  position  of  the  particle  before  a  move,  the  particle  has  two  alter¬ 
natives;  it  may  move  to  +  C^x  or  C^x  where  ,  C^,  and  are 

constants  subject  to  certain  constraints.  Several  theorems  are  proved 
which  specify  just  what  points  are  accessible  to  the  particle  in  a 
finite  number  of  steps  as  well  as  for  the  limiting  case  of  infinite 
steps . 


A  fixed  probability  law  which  makes  the  walk  random  is  assumed, 
i.e.  the  two  alternatives  described  above  are  assigned  probabilities 
p  and  q  and  p  +  q  =  1.  Then  the  distribution  function  for  the 
particle  position  after  a  given  number  of  steps  is  determined.  Finally 
there  is  derived  a  body  of  results  on  the  moments.  These  latter 
results  are  found  without  knowledge  of  the  distribution  functions. 


The  random  walk  has  served  as  a  model  or  analogue  for  a  wide  va¬ 
riety  of  problems  in  fields  as  unrelated  as  colloid  chemistry  and 
gambling.  The  problem  of  random  flights  was  considered  by  K.  Pearson 
around  the  turn  of  the  century.  In  that  problem  the  distribution  of 
position  of  a  particle  after  it  had  suffered  a  sequence  of  n  dis¬ 
placements  was  sought.  This  is  the  same  as  seeking  the  distribution 
of  the  sum  of  n  random  vectors,  each  vector  being  characterized  by  a 
probability  distribution.  Earlier  Lord  Rayleigh  had  studied  the  prob¬ 
lem  of  finding  the  distribution  of  the  composition  of  n  periodic 
vibrations  of  unit  amplitude  and  random  phases,  later  Smoluchowsld. 
and  Einstein  found  the  distribution  of  particles  in  Brownian  notion. 

In  1923,  Wiener  discussed  this  stochastic  process  rigorously* 

The  salient  feature  of  each  of  these  problems  is  the  distribution  of  a 
sum  of  random  variables,  each  random  variable  being  characterized  by 
an  assigned  distribution. 

Since  sums  of  random  variables  play  a  dominant  role  in  such  analyses 
it  is  natural  to  expand  on  the  applications  of  Lhe  methods  and  include 
all  problems  that  involve  additive  quantities  such  as  energy,  momentum, 
length,  financial  gain,  population,  etc. 

All  such  problems  may  be  thought  of  as  elaborations  (albeit  com¬ 
plicated)  on  the  simplest  one-dimensional  random  walk,  which  will  be 
described  now. 

A  particle  moves  along  a  straight  line  in  steps  at  times  t  =  1,2,5 
each  step  being  of  unit  length  and  taken  either  forward  or  backward  with 
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equal  probability,  1/2.  After  n  steps  the  particle  could  be  at  any 
of  the  points,  -n,-n+l,  ...,-l,0,+l,  ...,n-l,n.  The 
probability  that  the  particle  is  at  position  m  after  n  steps  is 
the  familiar  Bernoulli  distribution.  This  formulation  is  the  model 
for  one  of  the  simplest  of  gambling  problems,  viz.  that  of  the  gambler 
who  wins  or  loses  one  unit  of  money  at  each  play  of  the  game  and  he 
wins  and  loses  with  the  same  probability,  1/2. 

The  first  simple  generalization  of  the  one -dimensional  random 
walk  results  when  the  probability  of  a  forward  step  (winning)  is  not 
the  same  as  the  probability  of  a  backward  step  (losing) ,  but  rather 
p  and  q  respectively.  Further  generalizations  result  when  problems 
in  higher  dimensions  are  considered  and  problems  still  more  complicated 
result  when  reflecting  and  absorbing  barriers  are  introduced.  Again, 
appealing  to  the  gambler  analogue,  an  absorbing  barrier  at  the  origin 
represents  the  gambler's  ruin  point  and  problems  involving  probability 
of  ruin  and  duration  of  the  game  (number  of  steps  or  time  till  ruin  or 
absorption  at  a  barrier)  become  interesting  and  important.  These 
problems  have  now  become  'classical'  and  are  well  documented. 

One  property  tacitly  implied  in  all  of  the  work  discussed  above 
is  independence.  The  'step  lengths'  have  been  taken  to  be  statistically 
independent  and  in  most  cases  identically  distributed.  The  generali¬ 
zation  of  the  random  walk  which  is  discussed  here  imposes  a  special 
kind  of  dependence  among  the  random  variables  of  the  process.  Specifi¬ 
cally,  the  length  of  a  forward  step  is  made  to  be  different  from  that 
of  a  backward  step  and  these  step  lengths  depend  on  the  position  of 
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the  particle  before  the  step  is  taken.  The  probabilities  of  moving 
forward  or  backward  are  constants,  p  and  q(=  1  -  p) . 

These  studies  are  presented  in  three  parts.  The  first  part,  under 
this  cover,  treats  the  problem  of  finding  the  distribution  function  of 
the  particle  position  after  n  steps  and  the  limiting  case  for  large  n. 
Moments  for  particle  position  are  derived  exactly,  both  for  finite 
numbers  of  steps  and  for  the  limiting  case. 

Part  two  is  a  study  of  the  absorption  time  or  the  number  of  steps 
needed  for  a  particle  to  exceed  a  pre-assigned  level.  That  number  or 
time  is  a  random  variable  and  its  expected  value  is  studied  in  that 
paper. 


In  part  three  a  number  of  applications  are  presented  and  discussed. 
Some  of  these  applications  provided  the  motivation  for  these  studies 
and  the  formulation  of  these  phenomena  as  random  walks  is  shown  in 
detail. 

The  author  acknowledges  with  thanks  the  instructive  discussions 
he  has  had  with  L.  Takacs,  S.  Karlin,  J.  Gani,  R.  Pyke,  A.  Marshall, 
and  J.  Tysver  on  these  problems. 
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I.  Distribution  Functions  and  Moments. 

1.  Introduction* 

Consider  the  following  random  walk: 

A  particle  undergoes  excursions  along  the  x-axis  in  such  a  way 
that  the  position  after  n  steps  depends  on  its  postion  after  n  -1 
steps.  The  particle  at  each  position  is  subject  to  one  of  two  impulses 
and  its  motion  is  governed  by  a  fixed  probability  law.  Explicitly, 

+  ^2^Ti  1  probability  p 

X  =  (1) 

n 

CjX^  ^  with  probability  q(=  1  -  p) , 

where  x.  is  the  particle  position  after  j  steps  and  ,  C  ,  and  C, 

3  ^ 

are  constants  subject  to  a  set  of  constraints. 

Before  proceeding  to  the  analyses  of  this  random  walk  that  lead 
to  equations  for  distribution  functions  and  the  moments,  it  seems 
relevant  to  discuss  the  nature  of  the  motion  itself. 


2.  Motion  of  a  particle  in  the  random  walk. 

The  admissible  values  that  the  constants,  C. ,  C_,  and  C  may 

12  5 

assume  must  first  be  specified.  Later  on  certain  more  stringent  con¬ 
straints  will  be  treated  but  for  now  the  following  inequalities  will 
suffice : 

>  0 

0  <  <  1  (2) 

0  <  C,  <  1. 

? 


Now  consider  the  possible  positions  a  particle  may  occupy  after 
steps,  having  started  at  x,  when 


O  <  x  < 


n 
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^1 

Henceforth,  the  closed  interval,  [O,^ - ]  will  be  denoted  by  I. 

1  - 

Since  there  are  two  alternatives  at  each  step,  there  are  2^  pos¬ 
sible  positions  the  particle  may  occupy  after  n  steps.  For  example, 
after  one  step,  two  steps,  etc.  the  particle  may  be  at 


+  C^x  or 

C^x 


C^(l  +  C^)  +  c^x. 

Cl  +  C^CjX, 

of. 


(after  one  step). 


(5) 


(after  two  steps)  , 


ilc . 


These  points  are  determined  merely  by  repeated  application  of  equation  (1) 


S.  Karlin,  in  private  correspondence,  has  pointed  out  that  all 
such  positions  may  be  represented  by  a  single  expression.  Consider  the 
sequence  a  =  {a^  la^  ,a^ , .  .a^}  where  -  0  or  1.  There  are  2*^ 
such  sequences  of  length  n  and  they  generate  the  particle  positions 
as  follows.  If  t(a)  is  the  particle  position  corresponding  to  the 
sequence,  a. 


J-1  j-1 

S  a.  j-l-E  a. 


n 


n 


t(a)  =  C 


1  I 

j=l 


i=l 


'5 


S  a.  n-S  a, 

.  ,  1  .  T  1 

.  C-  V'  - 


(4) 


Note  that  in  the  limit,  i.e.  for  infinite  sequences,  the  dependence 
on  the  initial  position  vanishes.  Furthermore,  for  x  =  O,  all  sequences 
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may  be  considered  infinite  with  ali  terms  zero  after  the  nth  term  for 
the  n  -  length  finite  sequences;  {a^^  ,a^,  .  .a^^]  becomes  i®  • 

Also  observe  that  if  a  particle's  initial  position  is  in  the  interval,  I, 
it  can  never  leave  that  interval.  In  particular,  an  infinite  number 
of  forward  steps  (x  -*  +  C^x)  and  an  infinite  number  of  backward 

steps  (x  -•  C-^x)  yield  terminal  positions 

n  i  C 

lim  (C,  x)  =  r: - -pr-  and 

n  -  CD  •^i=0  "  ^  ~  ^2  (5) 

lijii  C"x  =  O 
n  -•  CD  ^ 

respectively . 

Thus  far  the  discussion  of  the  motion  has  been  concerned  with  the 
points  that  may  be  reached  from  an  initial  position  in  a  given  number 
of  steps.  The  points  attainable  in  n  steps  from  an  initial  position, 

X,  are  given  by  (4)  and  the  2^  n  -  length  sequences  of  zeros  and  ones,  a. 
Just  as  pertinent  to  these  analyses  is  the  question  of  whether  or  not 
a  given  point  in  the  interval,  I,  can  be  reached  from  any  other  point 
in  the  interval,  with  no  restriction  on  the  number  of  steps  that  it  may 
take.  This  is  the  same  as  asking  if  one  can  start  at  x  and  arrive 
at  x' ,  where  x  and  x*  are  arbitrary.  If  x'  cannot  be  reached 
from  X  in  a  finite  number  of  steps,  how  close  one  can  come  to  x  in 
a  finite  number  of  steps  is  also  interesting. 


To  consider  the  above  problems  it  is  nece 
constraints.  Those  constraints  given  by  (2)  s 


ship  between  and  must  be  considered. 


ssary  to  categorize  the 
till  hold  but  the  relation- 
Two  distinct  possibilities 


yield  slightly  diffeient  results.  Those  two  cases  are  given  by 


>  1  and 
C,  +  <  1  . 


It  is  also  expedient  to  recast  the  description  of  the  particle 
motion  in  the  language  of  operators.  Let  T^ ,  T^,  t  be 

operators  on  points  of  the  interval,  I,  defined  by 

TfX  =  +  C^x 


T^x  =  C^x 

X  -  C, 


T”^x  =  — 

Of  course,  the  inverse  operators,  T^^  and  ^2^’  seem  superfluous 

to  the  description  of  the  motion  since  the  random  walk  model  described 

x-C, 


here  does  not  admit  of  steps  that  carry  x  to 


or  X  to  r— . 


Moreover,  not  all  of  the  points  of  the  interval,  I,  are  in  the  domains 
-1  -2 

of  and  if  it  is  required  that  the  ranges  of  these  operators 
both  be  subsets  of  I.  The  usefulness  of  T^^  and  T^^  will  be  made 
clear  in  the  sequel  and  their  inclusion  among  definitions  here  is 


merely  for  completeness. 


Let  the  operator  T  be  a  generic  operator  indicating  either 
Tj^  or  Similarly  let  T  ^  mean  either  T^^^  or  '^2^ "  finally, 

T^  means  some  sequence  of  operations  using  T^'s  and  '^2'® 
means  some  sequence  of  operations  using  T^^'s  and  T^^'s. 
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Now  note  the  following  property  of  sequences  of  operations  on 
points  of  I.  For  £ill  x  and  x'  in  I, 


|t'"x  -  t'^x'  I  < 


1  -  C. 


where  c  =  maximuin  (C^,C  ).  The  constraints  given  by  (2)  guarantee 
that  the  difference  may  be  made  small.  The  inequality  (8)  follows 
immediately  by  direct  calculation!. 


|t'"x  -  T^x'  I 


|C2C^”‘'(x  -  x'  ) 


x-  I  < 


for  some  k(0  <  k  <  m)  depending  on  the  sequence  of  operations.  In  fact, 
k  is  just  the  number  of  times  T^^  appears  in  the  sequence  t"'  and, 
of  course,  m  -  k  is  the  number  of  times  T^  appears  in  t"'. 


Returning  to  the  discussion  of  the  approach  of  a  point  from  another 
point,  the  following  theorems  show  that  if  x  is  an  initial  point,  one 
can  come  arbitrarily  close  to  x  ',a  given  point  in  a  subset  of  I 
(the  subset  is  determined  by  the  constraints  (6)  and  x'  can  be  reached 
in  the  limit  • )  . 


Theorem  1 . 


>  0,  0  <  0^,0^  <  1,  >  1. 


Tx  =  T^x  or  T^x. 
xel,  x'  eI,  I= 


Given  an  e  >  0,  there  exists  an  M(e)  and  sequences  of  operations,  T, 
such  that  if  m  >  M, 

1t'"x  -  x'  I  <  e 
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The  sequence  of  transf oriUfjtions  used  above  need  some  closer 
scrutiny,  since  the  results  of  Theorem  1  may  otherwise  be  misleading. 
First  note  that  the  order  of  operations  in  the  t'''  sequence  in  (10) 
is  the  reverse  of  thit  in  the  T  sequence.  Since  neither  T^  and 

nor  Tji^^  and  T^^  commute,  the  order  of  operations  must  be  chosen 
this  way.  Then,  if  E  is  the  identity  transformation,  i.e.  Ex  =  x, 

_ T,  T  .T.TT^l'T^Tr^  ...  X  =  Ex  =  X  .  (11) 

k  a  i  1  J  k 

Now  (10)  implies  some  sort  of  convergence  of  sequences  of  operators 
etc.  and  convergence  depends  on  the  definition  of  tlie  sequences 
The  distinction  In  obvious  if  the  following  illustrations  are  considered 


10 


Let  euperscripts  indicate  operator  labels  and  let  (T)*"  indicate  m 
applications  of  T's.  Then  consider  the  following  sequence. 

T^x  =  (T)x 
T^T^x  =  (T)^x 

T^T'^T^x  =  (T)^x  (12) 

t'V'"^ _ T^x  =  (r)^. 

The  limit  of  (T)^x  always  yields  a  point  in  the  interval  but 
one  more  application  of  either  T^  or  T^  removes  a  particle  from 
that  point.  This  means  that  ohe  never  reaches  a  point  Xq  such  that 
T^Xq  =  Xq  and  =  x^.  So  the  sequences  defined  by  (12)  do  not 

converge . 


Now  consider  the  kind  of  se'juences  used  in  Theorem  1. 
T^x  (T)x 
tVx  =  (T)^x 

T^T^T^  ...t"'"^T%  =  (T)"'x 


(15) 


There  it  was  shown  that  for  every  point,  x' ,  in  the  interval,  I, 
there  exists  a  seciucnce  of  operations  on  an  arbitrary  starting  point, 
whose  limit  is  x' .  In  fact,  the  method  for  constructing  that  sequence 
yields  the  arrangement  (15) •  That  every  sequence  chosen  in  Ihe  manner 
that  t""  appears  in  Theorem  1  converges  is  demonstrated  in 


Theorem  2.  Every  seciuence  (15)  converges  uniformly  in  x. 
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Proof:  It  suffices  to  show  that  (15)  is  a  Cauchy  sequence. 
If  m  >  n,  (9)  gives 

|T  X  -  T  x|  =  |T  T  X  -  T  x|  <  c  |T  x  -  x| 

C, 


<  c 


1  -  C, 


(14) 


where  c  again  is  max(C^,Cj) 


and 


lim  It'^'x  -  t”x|  =  O  [uniform ly  1 . 
m  -•  <D 
n  -*  OD 


(15) 


The  other  case  considered  is  characterized  by  the  constraint, 

<  1.  Here  the  motion  is  not  so  simple  and  not  all  the  points 
in  the  interval,  I,  are  accessible  points.  Note  that  applying 
to  the  interval,  I  (the  transformations  may  now  be  thought  of  as  mapping 
sets  into  sets)  and  to  the  interval,  yields 

C,  C, 


'^1'^°’  1  -^c  ^  1 


(16) 


The  union  of  these  sets  does  not  cover  the  interval.  The  open 


interval,  ( 


- - ^  »  C- )  is  not  covered.  The  union  of  two  applications 

^  ^  C,C, 


of  T,  and  T^  on  I  leaves  uncovered  the  intervals,  (^ — ^  ^  ■,  C  ), 
X  d  X  -  Op  X 

C^C 


and 


C,  (1  +  u  ^  ,  C  (1  +  C  )).  Further  applications 

j.  X  —  O  _  i  c 


^  1  -  C  ’  ^l'^5^’ 

2  d 

of  T^  and  Tp  leave  additional  intervals  uncovered  in  the  same  way 
that  a  Cantor  set  is  constructed.  In  fact,  if  ^  »  ^2  ~ 

this  succession  of  steps  provides  a  method  for  constructing  the 
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Cantor  ternary  set.  Another  way  of  showing  this  is  by  noting  the  con¬ 
straints  on  the  inverse  operators  used  in  Theorem  1.  The  only  points, 
x'  ,  for  which  either  T^^^x*  or  T2^x'  is  admissible  as  a  first  backward 
step  are  in  the  set 


C,C 


Having  removed  the  interval  (r - ) ,  the  only  points  eligible 

1  -  1 

to  be  transformed  backward  another  step  are  in 

,2 


C,C 


C,C 


C.C, 


ro,3-^:u  [0^05,3-i^iu  co^.c^d  *  rc^a  *  op, 


Continuing  in  this  way,  it  is  clear  that  the  only  points  from  which 
one  may  start  in  a  sequence  of  backward  steps  belong  to  a  Cantor  set,^ 
The  companion  theorem  to  Theorem  1,  is  then, 


Theorem  5.  C^  >  0 ,  0  <  C^ ,C^  <  1 ,  C^  +  <  1 

x'  e  Xr,  the  Cantor  set  constructed  by  the  method  described 


above. 


For  all  X  in  I,  one  can  come  arbitrarily  close  to  x'  in  a 
finite  number  of  steps  and  can  always  reach  x'  in  an  infinite  number 
of  steps. 

Proof:  With  the  suitable  restrictions  de^;cribed  in  the  text,  the  proof 

follows  immediately  from  Theorem  1. 

Thus,  when  C^  +  <  1  and  x'  is  in  the  open  interval,  I  -x:, 

there  is  no  sequence  of  operations,  finite  or  infinite,  that  will  ter¬ 
minate  at  x'  except  the  trivial  case,  i.e.,  x  =  x'  and  the  sequence 
of  operations  is  oC  zero  length. 
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Observe  that  x'  can  be  reached  from  x  for  all  x'  in  I  so 
the  convergence  to  x'  is  uniform  in  x  (with  the  tacit  assumption 
that  x'  is  in  the  proper  interval) . 

Finally,  the  next  two  theorems  show  how  points  in  the  interval,  I, 
may  be  represented.  The  connection  between  the  behavior  of  a  particle 
suffering  impulses  given  by  the  transformations,  and  »  and  the 
representation  of  terminal  points  is  the  main  result.  Theorems  1,  2, 
and  3  and  the  representation  (4)  are  closely  related  and  this  relation 
is  made  obvious  by  these  two  theorems.  Without  loss  of  generality, 
the  initial  point,  x«  is  taken  to  be  zero. 


Theorem  4.  >  0,  O  <  0^,0^  <  1,  >  1. 

C-, 

X'  G  I  =  [O,  -  — -g-1  . 

There  exists  a  sequence  a  =  ^^,a2,...}t  where  =  0  or  1,  such  that 


n-1  n-1 

<D  E  a.  n-l-E  a. 

=  C  y  a  C 

1  Lt  n  2  5 


(17) 


If  x'  is  one  of  the  points  that  can  be  reached  from  zero  in  a 
finite  number  of  steps,  the  result  is  obvious.  Suppose  x'  cannot  be 
reached  from  zero  in  a  finite  number  of  steps.  Theorem  1  asserts  that 
there  exists  a  sequence  of  transformations  such  that 
lim  t"’o  =  x'  . 


m  CD 


(18) 


It  is  clear  that  the  tranaf ormations ,  and  T^,  correspond  to 

one  and  zero  respectively  in  the  sequence  a.  For  example, 


TiO  = 

T^O  =  0 

Vi°  =  ^1^^  ^ 
Vi°  = 


a  =  {1,0,0. . .} 
a  =  {0,0,0. . .] 
a  =  {1,1,0...} 
a  =  {0,1,0. . . ) 


Wl°  =  ""l^^  ^  ''2  ''2^  “  =  fl,l,l,0,0...} 

T  jT^Tj^O  ^  +  C^)  a  =  [o ,1 ,1 ,0 ,0. .  .  ] 


Therefore,  any  point  in  I  can  be  represented  by  (17)  if  the  sequence, 
a,  is  made  to  correspond  t<j  the  infinite  sequence  of  transformations  that 
yield  (18) . 


Ore  special  case  merits  consideration,  viz.  when  =  1. 

When  this  situation  obtains,  the  sequence  of  transformations  whose 

limit  is  x'  is  unique  (except  for  the  fact  that  T^T^T^T^...  is 

equivalent  to  '^2'^l'^l'^l  ’ "  ’  0.011...  is  equivalent  to  0.100  ... 

in  the  binary  expansion  of  a  number  in  the  unit  interval).  When 

C2  +  =  1  each  backward  step  in  Theorem  1  is  determined  uniquely 

since  T.^x'  and  T^^x*  can  never  be  in  I  simult  ineously .  For 

example,  if  C  <  x'  <  q - 7T“  the  first  inverse  transformation  must  be 

J.  X  — 

-1  ^ 

Tj^  .  Each  step  is  thus  determined  uniquely.  This  also  specifies  the 
sequence,  a,  uniquely.  If  the  first  inverse  transformation  is  T^^ , 
a^  =  1  ;  if  the  tr  nsformation  is  T^^,  a^  =  0.  Then  a^ ,  a^,  etc. 
are  i  hosem  the  .-.ame  way  and  (17)  gives  a  representation  for  x'  that 
is  unique.  An  obvious  special  case  arises  when  0,.=  C_  =  C  =  1/2. 

X  £1  p 
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Then  (17)  givet;  the  binary  expansion  for  numbers  in  the  unit  interval. 

A  number  written  in  binary  form  is  just  the  sequence,  a  ; 

i.e.,  x'  =  0.a,a_a,...  .  If  C-  +  C-  =  1  and  C  +  C,  >  1,  (17) 
i  d  i  ^  j 

gives  another  way  of  representing  a  number  in  the  unit  interval  using 
a  sequence  of  only  zeros  and  ones,  although  the  representation  may 
not  be  unique. 

Theorem  5-  C,  >  0,  0  <  C.,C,  <  1,  +  C,  <  1. 

i  d  c?  5 

X’  E  I  -id. 

Ihere  exists  a  sequence  a  =  {a^,a2,...},  where  =  0  or  1, 
such  that  x'  is  represented  by  (17). 

Proof:  The  proof  is  the  same  as  that  for  Theorem  4. 

These  convergence  theorems  and  representation  theorems  provide 
some  insight  into  the  nature  of  the  motion  of  a  particle  subject  to 
the  impulses  described  in  (l). 
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3*  Distribution  Functions. 

Recall  that  the  motion  of  a  particle  in  the  interval, 

1  - 

is  governed  by  the  fixed  probability  law  described  by  (1) .  The  dis¬ 
tribution  function  characterizing  the  particle  position  after  each 
step  is,  then,  determined  by  that  law.  Let  conditional 

probability  distribution  of  the  particle  position  after  n  steps. 
F^(t)  =  Pr{x^  <  t|xQ  =  Xq} 


F  (t)  =  1,  t  >  - — ipr- 
n  “  i  - 


F  (t)  =  0,  t  <  0. 
n  — 


n  =  0 ,  1 ,  2  ,  . . 


The  Conditioning  on  x^  has  been  here  suppressed  since  it  will 
always  be  apparent  when  it  applies. 


To  derive  expressions  for  F  ,  note  that  if  x  is  an  arbitrary 

n 

point  in  I(=  [O,  - - a  particle  can  reach  x  at  the  nth  step 

^  ^  “  ^1 

in  one  of  two  ways.  It  can  have  been  at  — = -  after  n  -  1  steps 

^2 

X 

and  advanced  to  x  with  probability,  p,  or  it  can  have  been  at  ^ 

after  n  -  1  steps  and  moved  to  x  with  probability,  q.  Therefore, 

the  distribution  functions,  F  and  F  are  related  by 

X  -  C  ’  " 

The  arguments  of  the  probability  measures  on  the  right  side  of 

X  -  X 

this  expression  are  the  sets,  [O,  — - - )  and  [O,  ),  and  they  are 

^2  S 

ordered  by  the  inclusion  relation 
X  -  C. 

Co,  — F-^)C  [0,  i  ). 


This  may  seem  to  make  (21)  in  uitively  unappealing  since  the 


probability  that  the  particle  is  at  a  point  less  than  —  includes  the 

X  -  ^5 

probability  that  it  is  at  a  point  less  than  — - - .  But  the  arguments 

^2 


II 
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used  above  also  show  that  the  differential  probability  that  a  particle 


(22) 


(23) 


is  at  X  after  n  steps  is 

Then  (Z^l)  follows  immediately  by 

XX  X 

J  dF  (t)  ==  p  J  dF  .(— - — h  +  q  J  dF  ,(^  ) 

0  n  ^  Q  n-1  0  n-1 

For  small  n,  Lt  is  easy  to  determine  F^^(x).  Repeated 
application  of  (21)  yields 


,  X  -  C  (1  +  C.,) 

p‘-F  A - ^ - —)  +  pqF  _( 

^  n~2  ^2 


X  -  C, 


n-2' 


^*^^0-2^  C  C  ^n-2^„2  ^ 

(24) 


X  -  C, 


=  P%(- 


-■)  +  ... 


/X  s 

+  q  Fo^:T>  . 


Every  term  on  the  right  side  of  (24)  involves  Fq(*)  and  since 


F^^(x)  =  O 
F„(x)  =  1 


x  <  x_ 


X  >  Xq, 


all  one  needs  to  do  to  determine  F^(x)  is  check  the  arguments  of  the 
individual  terms  and  subsLitue  zero  or  one  according  as  the  argument  is 
less  than  or  greater  than  x^,  the  conditioning  initial  point.  Some 
simplification  obtains  if  the  terms  are  examined  after  each  application 


i 
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of  (21)  since,  by  (20) 


r^(x)  =  1 

=  0 


^  -  1  -  ’c" 

X  <  O. 


O  <  k  <  n  -  1. 


Now  consider  the  limiting  distribution,  that  is,  the  distribution 
after  an  infinite  number  of  steps.  As  in  the  discussion  of  the  motion 
of  the  particle  (Section  2) ,  the  constraints  imposed  by  the  values  of 
,  and  become  important.  Furthermore,  the  relationships 

among  p,  q,  ,  and  enter  the  discussion. 

If  the  limiting  distribution  may  be  found  by  examining 

the  representation  of  a  point  given  by  Theorems  5  and  .5  and  noting  that 
the  transformation  corresponds  to  a  move  that  has  probability,  p, 

of  happening  and  corresponds  to  a  move  that  has  probability,  q. 

Theorem  5  shows  that  if  x  e.  Tt;  the  Cantor  set  constructed  in  Section  2, 
X  may  be  represented  by  equation  (17).  For  <  1,  x  is 


monotonic  in  a. 


“1  >  “2 


x^  >  • 


By  is  meant  th  t  if  the  a's  are  thought  of  as  binary 
numbers,  the  relation  between  those  numbers  determines  the  ordering 
of  the  a's.  For  example, 

(1,0,0,...}  >  (0,l,0,0,...l  >  {0,0, 1,0,0,...}. 


Notice  that  this  monotonicity  obtains  only  when  <  1, 

for  only  then  are  the  representations  unique  (see  Section  2) . 
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Now,  when  x  e^,  it  follows  that 


n-1  n-1 

E  a.  n-l-E  a. 


X  =  C,  )  a  C- 

1  Lj  n  2  5 


n-1  n-1 

E  a.  n-l-E  a 


Z.  ,  i  .  «  II 

1=1  1=1 
^nP  q 


If  X  iTk:,  it  is  necessary  to  determine  which  interval  contains 
X.  X  must  necessarily  be  a  member  of  one  of  tJie  intervals  removed  in 
constructing  If  X  e  (a,b),  then,  because  of  right  continuity 

and  monotonicity  of  F,  surely 

F(x)  =  F(a)  (26) 

and  a  e  so  F(a)  is  found  by  (25) •  Finding  the  interval  to  which 
X  belongs  involves  the  inverse  operator  procedure  outlined  in  Section  2. 
If  neither  T^^x  nor  T^^x  exists, 

F(x)  =  F(Y-i-^). 

1  - 

If  either  T^^x  or  T2^x  exists,  one  tries  the  next  inverse 
operation.  S;ay  T^^x  exists,  but  neither  T^^T^^x  nor  T^^T^^x 
exists.  Then  by  solving 

S  =  "iS 

1  -  C2 


for  x' , 


F(x)  =  H'(x')  =  F(Cj^(l  + 
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Continuing  in  this  way,  it  is  always  possible  to  find  the  interval 
to  which  X  belongs  and  since  F  is  monotone  it  is  surely 
constant  in  that  interval  and  equal  to  F(a)  where  a  is  the  left  end 
point  of  the  Interval. 


Next 


,  consider  the  limiting  distribution  when  C_  +  C- 

C  ^ 


+  C,  =  1.  In 


this  case,  every  x  in  [0,t - ^"1  may  be  expressed  by  (17)  and  this 

^  ■  ^2 

representation  is  unique.  For  all  x,  F(x)  is  given  by  (25).  However, 
some  special  cases  are  interesting  and  admit  of  expressions  simpler 
than  (25) • 


If  p  =  C  and  q  =  C  ,  observe  from  (25)  that 

C  5 

F(x)  =  ^  X  =  ^x. 

^1 


(27) 


If  p  <  C^,q  >  C^,  and  =  1,  F(x)  becomes  concave  and, 

similarly,  if  p  >  C^,  q  <  C^,  and  =  1,  F(x)  becomes  convex. 

Figure  1  illustrates  three  cases: 


Curve  A;  p  =  C^,  q  =  C^ 

Curve  B:  p  <  C^,  q  > 

Curve  C:  p  >  C^ ,  q  < 
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For  purposes  of  application,  F(x)  may  be  approximated  by  noting 
the  agreement  between  (25)  and: 


Q 

F(x)  =  x)*^  iP  = 

1  5 


-  (1  -  ^  x)"*  <  X  <  ^  , 


_  iiL£ 


In  C^* 


2  k  6  6 

For  X  =  ,C^C^,C^C^, . .  ,  F(x)  =  x)^  agrees  exactly  with  (25) 

2  ^  ^3  k 

and  for  x  =  C,  ,  2;— (l  -  C  ),  — (  1  -  C^),...— (l  -  C  ),..., 

1  2  0^  2  0^  2 

C  . 

F(x)  =  1  -  (1  -  x)°  agrees  with  (25)* 

t<. 


Finally,  a  convenient  check  is  available  for  all  of  the  expressions 
for  F.  The  equation  for  the  limiting  distribution  which  corresponds 
to  (21)  is 

x  -  C 

F(x)  =  pF(-  „-■--)  +  qr(^  ),  (29) 

^2  S 

again  with  the  obvious  conditions. 


F(x)  =  0 


X  <  0 


^^i-Tc: 


Only  those  distributions  for  which  =  1  are  considered. 

When  <  1,  the  same  arguments  apply  and  that  case  lends  nothing 

to  the  discussion. 


Suppose  =  1.  Then  if  x  <  ,  the  first  element  of  the 

sequence,  a,  corresponding  to  x  is  a  zero.  If  x  >  C^,  the  first 
element  is  a  one.  When  x  =  C^, 

=  {.1,0,0, ...j  =  {.0 , 1 , 1 , . . .  J  o 


r 
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Now  conaider  (25)-  If  x  <  , 

X  =  fO.u^ .Sj, . . .] 


5 


2’  3’ 


F(x)  =  qF(^  ). 

^3 

cl„  2— tA«  cl„+a^ 

T,/  \  /  22  23  23 

F(x)  =  qCa^q  +  a^p  q  +  a,^p  q 

_  a_  1-a^  a.+a,  2-(a_+a,) 

id  /  £Z  £L  J  id  ^ 

=  q  (a^  +  a^p  q  +  a^p  q 


(30) 


=  qF(^  ) 


If  X  >  C^, 


X  =  1.1,82,3^,  . . .  j 


X  -  C 


~  =  I a^ ,a  , . . . } 


2’  5’ 

X  -  Cf 

F(x)  =  pF( — - )  +  q 

°2 


(51) 


^2  ■“  ''••“2 
F(x)  =  q(l  +  a^P  +  a^p  q 


l+a^  2-(l+a-)  1+a  +a  3-(l+a-+a,) 


+  a^^p 


2  5„ 


‘2^"3 


+  •  •  • ) 


a^  2-(l+a2) 

=  pqCa^  +  a^p  “q  +...)+  q 

X  -  C, 


pF(-7^ - )  +  q. 


Wlien  p  =  C  and  q  =  C  ,  (27)  gives 


F(x)  =  TT^X. 


r 


Then,  if  x  <  ,  (29)  becomes 

F(x)  =  qF(^  ) , 


F(x)  =  TT^x  =  q^  =  qF(^)  . 


(32) 
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For  X  >  , 

X  —  C 

F(x)  =  pF( — - — i)  +  q, 


C,x  C,x  C,  C 


F(x)  =  ^  - +  C  =  pF( 


X  -  C, 


^2  ^2 


-)  +  q. 


Equations  (28)  also  check  with  (29)  but  since  those  equations  are 
only  approximate,  the  agreement  is,  of  course,  only  approximate.  The 
interested  reader  may  verify  this  by  using  numerical  examples. 


The  distributions  discussed  above  are  all  based  on  the  motion  of 
a  particle  confined  to  an  interval.  The  constraints  given  in  (2)  assure 
that  the  particle  never  leaves  that  interval.  One  other  case  merits 
mention  here,  viz.  that  of  a  particle  moving  on  the  positive  real  axis. 
Although  the  results  are  well  known,  they  are  included  here  in  the 
interest  of  completeness.  To  achieve  unrestricted  motion  to  the  right, 
the  constraints  become 
=  0, 

C2  >  1, 

0  <  <  1. 

Then  x  ”*  C^x  with  probability  p  and  x  -  C^x  with  proability  q. 

The  initial  point,  Xq,  cannot  be  taken  as  zero  for  then  the  particle 
would  never  leave  the  origin. 


For  small  n,  determination  of  F  is  the  same  as  before. 
Repeated  application  of  (21)  yields  an  equation  involving  only  Fq 
at  2^  arguments  and  then  it  remains  but  to  check  each  argument 


relative  to  x, 
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For  n  large,  another  method  is  available.  First  rewrite  the 
expression  for  as  follows 

=  x^  ^  +  (C.^  -  l)x^  ^  with  probability  p 

X 

=  x^  +  (C^  -  l)x^  with  probability  q. 

Then 

X  -  X  ,  (C  ,  -  1)  with  probability  p 
n  n-1  _  2  ^  r- 

x^  ”^*^3  ~  with  probability  q. 

If  5  is  the  random  variable  that  takes  on  the  two  values, 

(C^  -  1)  and  (C^  -  1)  with  probabilities  p  and  q  respectively, 
we  have 


n  X.  -  X.  n 

^  ^  f 

•  T  X'  T  ~  •  T  i 

1=1  1-1  1=1 

The  first  and  second  moments  of  5 

m  =  E(5)  =  pC^  +  qC^  -  1 

E(5^)  =  pCC^  -  20^  +  1)  +  q{c|  -  2C^  +  1) 

=  P^p  ~  2(pC2  +  1 

o^  =  E(?^)  -  (E(?))^  =  pq(c^  -  C^)^. 


(55) 


(56) 


The  right  side  of  (35)  is  just  the  sum  of  n  independent, 
identically  distributed  random  variables.  Using  standard  techniques 
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from  the  central  limit  theorem,  the  log-normal  distribution  for  x 

n 

(n  large)  is  easily  achieved. 

F  (x)  =  Prfx  <  x}  B3 
n  n  — 


(57) 


where  m  and  o  are  given  by  (56). 
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4.  Moments. 

The  moments  for  the  distributions  of  particle  positions  in  the 
random  walk  treated  here  are  easily  derivable  in  exact  form.  The 
distribution  functions  do  not  appear  in  the  derivation  nor  do  the 
combinations  of  constraints.  The  only  constraints  are  those  given 
by  (2)  . 


In  order  to  study  the  moment  problem,  it  is  convenient  to  cast 
the  problem  differently.  Let 

X  =  (C,  +  C.,x  -)e  +  C.^x  .,(1  -  9  )  (58) 

n  1  2  n-1  n  5  n-1  a 

where  the  random  variable  0^  is  given  by 
=  1  with  probability  p 

9^  (59) 

=  0  with  probability  q. 


X  =  u  +  V  X  , 
n  n  n  n-1 


where 


u  =  C,  9 
n  In 

v  =  c.e  +  C,(l  -  9  ). 

n  2  n  5  n 


It  is  convenient  to  introduce  a  table  of  moments  for  the  u's 

and  v's.  Equations  (59)  and  (4l)  give 

E(u^)  =  pC^ 

E(Vn)  =  pC^  +  qC^  =  K 

E(u  V  )  =  pC-,C_ 

n  n  ^12 

E(u^)  =  pcf 

n  ^1 

B(v^)  =  pC^  +  qC^  =  . 


(42) 
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Now  repeated  application  of  (58)  yields  an  expression  for  x 


in  terms  of  u's,  v's,  and  x 


X  =  u  +  V  X  , 
n  n  n  n-1 

=  u  +  V  (u  , 
n  n  n-1 


O' 


V  1 X  _) 

n-1  n-2 


'n-l 

=  %  Llo  %-k^  ^  ^0  iio  ''n-^- 

Applying  (42)  to  (43)  gives  for  the  mean  of  x  , 

n 


E(x  )  =  E(u  )  + 
n  n 

n-1 


jzi 


n-1 


E  E(u  .)  E(v  )  +  x_  E(v  f) 

n-j  k=0  n-k  0  ^=0  n-t 

n-1  — ^ 

=  E(u  )  +  E(u  )  E  (E(v.))'^  +  x„  E(v  .) 
n  n  j  0  ^=0  n— t 

n-1  . 

=  pC^  +  pC^  E  kJ  +  XqK” 
j=l 

„  „(1  -  .,n 

=  p^i^i  +  K  -Q-r-jn-  ^ 


(43) 


(44) 


„  (1  -  K  )  „r 

=  PS  TITk)  ^  ’'0'^ 


To  find  the  second  moment,  we  first  square  the  right  side  of  (43) 
and  then  apply  (42  )  . 
n-1 

2  2  ry,  ,  II  X  ^2  2  I  I  2 

X  =  u  +|i-(u  .,V,v  +x^ 

”  "  n-j  k=0  n-k  ^ 


0=1 


0  ^=0  n-l  ^ 
n-1 

tu  +  X„U  1  S  V  .  + 

n._j^  n-j  k=0  n-k  0  n  ^=0  n-l 


n-1 

2(u^  E  (u„  ,  IL  v„  J 

j 

n-1 


(45) 


n-l 


ibl 


^0  ^=0  k=0  Vk^-* 


j=l 
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The  expectations  oi  the  individual  terms  are 

ECu^)  =  pcj  , 


n-1 

Ei[  S  (u 


"  V  )n  = 

n-j  k=0  n-k'^-'  ■’ 


1  1  ^-1 
n-1  n-1  ^  jy 

El  2  S  u  .u  ,  '  V  '  '  V  }  = 

•  1  «  T  n-j  n-^  k=0  n-k  m=:0  n-m'’ 

j=j. 


"zKia  -  K"-'-) , 

(1  -  K^)  1  -  K  i=l 

n-1 

TPi  2  I  I  2  I  2„n 

jK=.0  -  ^0^2  ’ 


<“„-j  ilo  "n-kn  =  2<p=i)S 

0 


®f2XoU„  lio  v^_,]  =  Sx^pC^C^K"-^  , 

n-1  i-l  -  k”~^) 

Ho  ''n-A  ^“n-j  k=0  ''n-k^^  “  ^’‘oP^1^2^2  (K  -  K  )  ' 

3  t  2 


Collecting  terms. 


P  P  (1  -  k")  (pC  )^C  (1  -  k" 

"^^n)  =  P^l  (r-TlT)  ^  2 

2  n 

2  n  -  *^2^ 

XqK^  +  2XqPC^C2  (k  _  K^)  ’ 


K(k”"^  - 
(K  -  K  ) 
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Higher  moments  are  derivable  in  exactly  the  same  way  as 
2 

and  E(x^)  but  no  purpose  is  served  in  dwelling  further  on  those 
moments. 


The  moments  for  the  limiting  distributions  may  be  obtained 
immediately  from  (44)  and  (4?).  If  x  is  the  random  variable 
denoting  position  after  an  infinite  number  of  steps, 

PCn 


E(x)  = 


1  -  K 

,2 


pC^  2pC 

E(x^)  =  T— V(1  +  ^ 


1  -  K, 


) 


(48) 


22  2 

<3  =  E(x  )  -  (E(x))  =  - - — p - ^ - 

(1  -  K)^(l  -  K^) 


The  moments  derived  here  provide  a  check  for  at  least  one  of  the 
distributions  derived  in  Section  5*  \'4ien  p  =  and  q  =  C^, 


equation  (27)  gives 
F(x)  =  TT^x 


S  r  ^ 

E(x)  =  ^  J  xdx 
^  0 


(49) 


:;i 

2C, 
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Equation  (48)  gives  for  E(x), 


E(x)  = 


2  2 
1  -  -  C, 


^2^1 

2C2C5 


2C. 


Similarly, 


(50) 


2 

HU) 


f 


X  dx  = 


3C, 


From  (48) 


E(x^) 


PCn 


2C" 


PC 


3C2C5 


(1  + 


2  ^^2  ^5^ 


2C  C 

23 


(51) 


(52) 


3C 


3 


This  work  on  the  derivation  of  moments  for  distributions  of 
particle  positions  in  the  random  walk  treated  here  was  done  simul¬ 


taneously  with  some  work  of  J.  B.  Tysver  on  the  same  subject.  The 
results  were  obtained  independently. 
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